The development of tone discrimination in infancy: Evidence from a cross-linguistic, multi-lab report.

We report the findings of a multi-language and multi-lab investigation of young infants' ability to discriminate lexical tones as a function of their native language, age and language experience, as well as of tone properties. Given the high prevalence of lexical tones across human languages, understanding lexical tone acquisition is fundamental for comprehensive theories of language learning. While there are some similarities between the developmental course of lexical tone perception and that of vowels and consonants, findings for lexical tones tend to vary greatly across different laboratories. To reconcile these differences and to assess the developmental trajectory of native and non-native perception of tone contrasts, this study employed a single experimental paradigm with the same two pairs of Cantonese tone contrasts (perceptually similar vs. distinct) across 13 laboratories in Asia-Pacific, Europe and North-America testing 5-, 10- and 17-month-old monolingual (tone, pitch-accent, non-tone) and bilingual (tone/non-tone, non-tone/non-tone) infants. Across the age range and language backgrounds, infants who were not exposed to Cantonese showed robust discrimination of the two non-native lexical tone contrasts. Contrary to this overall finding, the statistical model assessing native discrimination by Cantonese-learning infants failed to yield significant effects. These findings indicate that lexical tone sensitivity is maintained from 5 to 17 months in infants acquiring tone and non-tone languages, challenging the generalisability of the existing theoretical accounts of perceptual narrowing in the first months of life. RESEARCH HIGHLIGHTS: This is a multi-language and multi-lab investigation of young infants' ability to discriminate lexical tones. This study included data from 13 laboratories testing 5-, 10-, and 17-month-old monolingual (tone, pitch-accent, non-tone) and bilingual (tone/non-tone, non-tone/non-tone) infants. Overall, infants discriminated a perceptually similar and a distinct non-native tone contrast, although there was no evidence of a native tone-language advantage in discrimination. These results demonstrate maintenance of tone discrimination throughout development.

Seeing a Talking Face Matters: Gaze Behavior and the Auditory-Visual Speech Benefit in Adults' Cortical Tracking of Infant-directed Speech.

In face-to-face conversations, listeners gather visual speech information from a speaker's talking face that enhances their perception of the incoming auditory speech signal. This auditory-visual (AV) speech benefit is evident even in quiet environments but is stronger in situations that require greater listening effort such as when the speech signal itself deviates from listeners' expectations. One example is infant-directed speech (IDS) presented to adults. IDS has exaggerated acoustic properties that are easily discriminable from adult-directed speech (ADS). Although IDS is a speech register that adults typically use with infants, no previous neurophysiological study has directly examined whether adult listeners process IDS differently from ADS. To address this, the current study simultaneously recorded EEG and eye-tracking data from adult participants as they were presented with auditory-only (AO), visual-only, and AV recordings of IDS and ADS. Eye-tracking data were recorded because looking behavior to the speaker's eyes and mouth modulates the extent of AV speech benefit experienced. Analyses of cortical tracking accuracy revealed that cortical tracking of the speech envelope was significant in AO and AV modalities for IDS and ADS. However, the AV speech benefit [i.e., AV > (A + V)] was only present for IDS trials. Gaze behavior analyses indicated differences in looking behavior during IDS and ADS trials. Surprisingly, looking behavior to the speaker's eyes and mouth was not correlated with cortical tracking accuracy. Additional exploratory analyses indicated that attention to the whole display was negatively correlated with cortical tracking accuracy of AO and visual-only trials in IDS. Our results underscore the nuances involved in the relationship between neurophysiological AV speech benefit and looking behavior.

Does Musicality Assist Foreign Language Learning? Perception and Production of Thai Vowels, Consonants and Lexical Tones by Musicians and Non-Musicians.

The music and spoken language domains share acoustic properties such as fundamental frequency (f0, perceived as pitch), duration, resonance frequencies, and intensity. In speech, the acoustic properties form an essential part in differentiating between consonants, vowels, and lexical tones. This study investigated whether there is any advantage of musicality in the perception and production of Thai speech sounds. Two groups of English-speaking adults-one comprising formally trained musicians and the other non-musicians-were tested for their perception and production of Thai consonants, vowels, and tones. For both groups, the perception and production accuracy scores were higher for vowels than consonants and tones, and in production, there was also better accuracy for tones than consonants. Between the groups, musicians (defined as having more than five years of formal musical training) outperformed non-musicians (defined as having less than two years of formal musical training) in both the perception and production of all three sound types. Additional experiential factors that positively influenced the accuracy rates were the current hours of practice per week and those with some indication of an augmentation due to musical aptitude, but only in perception. These results suggest that music training, defined as formal training for more than five years, and musical training, expressed in hours of weekly practice, facilitate the perception and production of non-native speech sounds.

Effects of maternal depression on maternal responsiveness and infants' expressive language abilities.

High levels of maternal responsiveness are associated with healthy cognitive and emotional development in infants. However, depression and anxiety can negatively impact individual mothers' responsiveness levels and infants' expressive language abilities. Australian mother-infant dyads (N = 48) participated in a longitudinal study examining the effect of maternal responsiveness (when infants were 9- and 12-months), and maternal depression and anxiety symptoms on infant vocabulary size at 18-months. Global maternal responsiveness ratings were stronger predictors of infants' vocabulary size than levels of depression and anxiety symptoms. However, depression levels moderated the effect of maternal responsiveness on vocabulary size. These results highlight the importance of screening for maternal responsiveness-in addition to depression-to identify infants who may be at developmental risk. Also, mothers with elevated depression need support to first reduce their symptoms so that improvements in their responsiveness have the potential to be protective for their infant's language acquisition.

Seeing a talking face matters: Infants' segmentation of continuous auditory-visual speech.

Visual speech cues from a speaker's talking face aid speech segmentation in adults, but despite the importance of speech segmentation in language acquisition, little is known about the possible influence of visual speech on infants' speech segmentation. Here, to investigate whether there is facilitation of speech segmentation by visual information, two groups of English-learning 7-month-old infants were presented with continuous speech passages, one group with auditory-only (AO) speech and the other with auditory-visual (AV) speech. Additionally, the possible relation between infants' relative attention to the speaker's mouth versus eye regions and their segmentation performance was examined. Both the AO and the AV groups of infants successfully segmented words from the continuous speech stream, but segmentation performance persisted for longer for infants in the AV group. Interestingly, while AV group infants showed no significant relation between the relative amount of time spent fixating the speaker's mouth versus eyes and word segmentation, their attention to the mouth was greater than that of AO group infants, especially early in test trials. The results are discussed in relation to the possible pathways through which visual speech cues aid speech perception.

Impaired neural entrainment to low frequency amplitude modulations in English-speaking children with dyslexia or dyslexia and DLD.

Neural synchronization to amplitude-modulated noise at three frequencies (2 Hz, 5 Hz, 8 Hz) thought to be important for syllable perception was investigated in English-speaking school-aged children. The theoretically-important delta-band (∼2Hz, stressed syllable level) was included along with two syllable-level rates. The auditory steady state response (ASSR) was recorded using EEG in 36 7-to-12-year-old children. Half of the sample had either dyslexia or dyslexia and DLD (developmental language disorder). In comparison to typically-developing children, children with dyslexia or with dyslexia and DLD showed reduced ASSRs for 2 Hz stimulation but similar ASSRs at 5 Hz and 8 Hz. These novel data for English ASSRs converge with prior data suggesting that children with dyslexia have atypical synchrony between brain oscillations and incoming auditory stimulation at âˆ¼ 2 Hz, the rate of stressed syllable production across languages. This atypical synchronization likely impairs speech processing, phonological processing, and possibly syntactic processing, as predicted by Temporal Sampling theory.

Infants show enhanced neural responses to musical meter frequencies beyond low-level features.

Music listening often entails spontaneous perception and body movement to a periodic pulse-like meter. There is increasing evidence that this cross-cultural ability relates to neural processes that selectively enhance metric periodicities, even when these periodicities are not prominent in the acoustic stimulus. However, whether these neural processes emerge early in development remains largely unknown. Here, we recorded the electroencephalogram (EEG) of 20 healthy 5- to 6-month-old infants, while they were exposed to two rhythms known to induce the perception of meter consistently across Western adults. One rhythm contained prominent acoustic periodicities corresponding to the meter, whereas the other rhythm did not. Infants showed significantly enhanced representations of meter periodicities in their EEG responses to both rhythms. This effect is unlikely to reflect the tracking of salient acoustic features in the stimulus, as it was observed irrespective of the prominence of meter periodicities in the audio signals. Moreover, as previously observed in adults, the neural enhancement of meter was greater when the rhythm was delivered by low-pitched sounds. Together, these findings indicate that the endogenous enhancement of metric periodicities beyond low-level acoustic features is a neural property that is already present soon after birth. These high-level neural processes could set the stage for internal representations of musical meter that are critical for human movement coordination during rhythmic musical behavior. RESEARCH HIGHLIGHTS: 5- to 6-month-old infants were presented with auditory rhythms that induce the perception of a periodic pulse-like meter in adults. Infants showed selective enhancement of EEG activity at meter-related frequencies irrespective of the prominence of these frequencies in the stimulus. Responses at meter-related frequencies were boosted when the rhythm was conveyed by bass sounds. High-level neural processes that transform rhythmic auditory stimuli into internal meter templates emerge early after birth.

Language specificity in cortical tracking of speech rhythm at the mora, syllable, and foot levels.

Recent research shows that adults' neural oscillations track the rhythm of the speech signal. However, the extent to which this tracking is driven by the acoustics of the signal, or by language-specific processing remains unknown. Here adult native listeners of three rhythmically different languages (English, French, Japanese) were compared on their cortical tracking of speech envelopes synthesized in their three native languages, which allowed for coding at each of the three language's dominant rhythmic unit, respectively the foot (2.5 Hz), syllable (5 Hz), or mora (10 Hz) level. The three language groups were also tested with a sequence in a non-native language, Polish, and a non-speech vocoded equivalent, to investigate possible differential speech/nonspeech processing. The results first showed that cortical tracking was most prominent at 5 Hz (syllable rate) for all three groups, but the French listeners showed enhanced tracking at 5 Hz compared to the English and the Japanese groups. Second, across groups, there were no differences in responses for speech versus non-speech at 5 Hz (syllable rate), but there was better tracking for speech than for non-speech at 10 Hz (not the syllable rate). Together these results provide evidence for both language-general and language-specific influences on cortical tracking.

Seeing a talking face matters: The relationship between cortical tracking of continuous auditory-visual speech and gaze behaviour in infants, children and adults.

An auditory-visual speech benefit, the benefit that visual speech cues bring to auditory speech perception, is experienced from early on in infancy and continues to be experienced to an increasing degree with age. While there is both behavioural and neurophysiological evidence for children and adults, only behavioural evidence exists for infants - as no neurophysiological study has provided a comprehensive examination of the auditory-visual speech benefit in infants. It is also surprising that most studies on auditory-visual speech benefit do not concurrently report looking behaviour especially since the auditory-visual speech benefit rests on the assumption that listeners attend to a speaker's talking face and that there are meaningful individual differences in looking behaviour. To address these gaps, we simultaneously recorded electroencephalographic (EEG) and eye-tracking data of 5-month-olds, 4-year-olds and adults as they were presented with a speaker in auditory-only (AO), visual-only (VO), and auditory-visual (AV) modes. Cortical tracking analyses that involved forward encoding models of the speech envelope revealed that there was an auditory-visual speech benefit [i.e., AV > (A + V)], evident in 5-month-olds and adults but not 4-year-olds. Examination of cortical tracking accuracy in relation to looking behaviour, showed that infants' relative attention to the speaker's mouth (vs. eyes) was positively correlated with cortical tracking accuracy of VO speech, whereas adults' attention to the display overall was negatively correlated with cortical tracking accuracy of VO speech. This study provides the first neurophysiological evidence of auditory-visual speech benefit in infants and our results suggest ways in which current models of speech processing can be fine-tuned.

The tone atlas of perceptual discriminability and perceptual distance: Four tone languages and five language groups.

Some prior investigations suggest that tone perception is flexible, reasonably independent of native phonology, whereas others suggest it is constrained by native phonology. We address this issue in a systematic and comprehensive investigation of adult tone perception. Sampling from diverse tone and non-tone speaking communities, we tested discrimination of the three major tone systems (Cantonese, Thai, Mandarin) that dominate the tone perception literature, in relation to native language and language experience as well as stimulus variation (tone properties, presentation order, pitch cues) using linear mixed effect modelling and multidimensional scaling. There was an overall discrimination advantage for tone language speakers and for native tones. However, language- and tone-specific effects, and presentation order effects also emerged. Thus, over and above native phonology, stimulus variation exerts a powerful influence on tone discrimination. This study provides a tone atlas, a reference guide to inform empirical studies of tone sensitivity, both retrospectively and prospectively.

Language development in infants with hearing loss: Benefits of infant-directed speech.

The majority of infants with permanent congenital hearing loss fall significantly behind their normal hearing peers in the development of receptive and expressive oral communication skills. Independent of any prosthetic intervention ("hardware") for infants with hearing loss, the social and linguistic environment ("software") can still be optimal or sub-optimal and so can exert significant positive or negative effects on speech and language acquisition, with far-reaching beneficial or adverse effects, respectively. This review focusses on the nature of the social and linguistic environment of infants with hearing loss, in particular others' speech to infants. The nature of this "infant-directed speech" and its effects on language development has been studied extensively in hearing infants but far less comprehensively in infants with hearing loss. Here, literature on the nature of infant-directed speech and its impact on the speech perception and language acquisition in infants with hearing loss is reviewed. The review brings together evidence on the little-studied effects of infant-directed speech on speech and language development in infants with hearing loss, and provides suggestions, over and above early screening and external treatment, for a natural intervention at the level of the carer-infant microcosm that may well optimize the early linguistic experiences and mitigate later adverse effects for infants born with hearing loss.

Acoustic features of infant-directed speech to infants with hearing loss.

This study investigated the effects of hearing loss and hearing experience on the acoustic features of infant-directed speech (IDS) to infants with hearing loss (HL) compared to controls with normal hearing (NH) matched by either chronological or hearing age (experiment 1) and across development in infants with hearing loss as well as the relation between IDS features and infants' developing lexical abilities (experiment 2). Both experiments included detailed acoustic analyses of mothers' productions of the three corner vowels /a, i, u/ and utterance-level pitch in IDS and in adult-directed speech. Experiment 1 demonstrated that IDS to infants with HL was acoustically more variable than IDS to hearing-age matched infants with NH. Experiment 2 yielded no changes in IDS features over development; however, the results did show a positive relationship between formant distances in mothers' speech and infants' concurrent receptive vocabulary size, as well as between vowel hyperarticulation and infants' expressive vocabulary. These findings suggest that despite infants' HL and thus diminished access to speech input, infants with HL are exposed to IDS with generally similar acoustic qualities as are infants with NH. However, some differences persist, indicating that infants with HL might receive less intelligible speech.

Maternal Depression Affects Infants' Lexical Processing Abilities in the Second Year of Life.

Maternal depression and anxiety have been proposed to increase the risk of adverse outcomes of language development in the early years of life. This study investigated the effects of maternal depression and anxiety on language development using two approaches: (i) a categorical approach that compared lexical abilities in two groups of children, a risk group (mothers with clinical-level symptomatology) and a control non-risk group, and (ii) a continuous approach that assessed the relation between individual mothers' clinical and subclinical symptomatology and their infants' lexical abilities. Infants' lexical abilities were assessed at 18 months of age using an objective lexical processing measure and a parental report of expressive vocabulary. Infants in the risk group exhibited lower lexical processing abilities compared to controls, and maternal depression scores were negatively correlated to infants' lexical processing and vocabulary measures. Furthermore, maternal depression (not anxiety) explained the variance in infants' individual lexical processing performance above the variance explained by their individual expressive vocabulary size. These results suggest that significant differences are emerging in 18-month-old infants' lexical processing abilities, and this appears to be related, in part, to their mothers' depression and anxiety symptomatology during the postnatal period.

Depression and Anxiety in the Postnatal Period: An Examination of Infants' Home Language Environment, Vocalizations, and Expressive Language Abilities.

This longitudinal study investigated the effects of maternal emotional health concerns, on infants' home language environment, vocalization quantity, and expressive language skills. Mothers and their infants (at 6 and 12 months; 21 mothers with depression and or anxiety and 21 controls) provided day-long home-language recordings. Compared with controls, risk group recordings contained fewer mother-infant conversational turns and infant vocalizations, but daily number of adult word counts showed no group difference. Furthermore, conversational turns and infant vocalizations were stronger predictors of infants' 18-month vocabulary size than depression and anxiety measures. However, anxiety levels moderated the effect of conversational turns on vocabulary size. These results suggest that variability in mothers' emotional health influences infants' language environment and later language ability.

Novel word learning deficits in infants at family risk for dyslexia.

Children of reading age diagnosed with dyslexia show deficits in reading and spelling skills, but early markers of later dyslexia are already present in infancy in auditory processing and phonological domains. Deficits in lexical development are not typically associated with dyslexia. Nevertheless, it is possible that early auditory/phonological deficits would have detrimental effects on the encoding and storage of novel lexical items. Word-learning difficulties have been demonstrated in school-aged dyslexic children using paired associate learning tasks, but earlier manifestations in infants who are at family risk for dyslexia have not been investigated. This study assessed novel word learning in 19-month-old infants at risk for dyslexia (by virtue of having one dyslexic parent) and infants not at risk for any developmental disorder. Infants completed a word-learning task that required them to map two novel words to their corresponding novel referents. Not at-risk infants showed increased looking time to the novel referents at test compared with at-risk infants. These findings demonstrate, for the first time, that at-risk infants show differences in novel word-learning (fast-mapping) tasks compared with not at-risk infants. Our findings have implications for the development and consolidation of early lexical and phonological skills in infants at family risk of later dyslexia.

Delayed development of phonological constancy in toddlers at family risk for dyslexia.

Phonological constancy refers to infants' ability to disregard variations in the phonetic realisation of speech sounds that do not indicate lexical contrast, e.g., when listening to accented speech. In typically-developing infants, this ability develops between 15- and 19-months of age, coinciding with the consolidation of infants' native phonological competence and vocabulary growth. Here we investigated the developmental time course of phonological constancy in infants at family risk for developmental dyslexia, using a longitudinal design. Developmental dyslexia is a disorder affecting the acquisition of reading and spelling skills, and it also affects early auditory processing, speech perception, and lexical acquisition. Infants at-risk and not at-risk for dyslexia, based on a family history of dyslexia, participated when they were 15-, 19-, and 26-months of age. Phonological constancy was indexed by comparing at-risk and not at-risk infants' ability to recognise familiar words in two preferential looking tasks: (1) a task using words presented in their native accent, and (2) a task using words presented in a non-native accent. We expected a delay in phonological constancy for the at-risk infants. As predicted, in the non-native accent task, not at-risk infants recognised familiar words by 19 months, but at-risk infants did not. The control infants thus exhibited phonological constancy. By 26 months, at-risk toddlers did show successful word recognition in the native accent task. However, for the non-native accent task at 26 months, neither at-risk nor control infants showed familiar word recognition. These findings are discussed in terms of the impact of family risk for dyslexia on toddlers' consolidation of early phonological and lexical skills.

Sensitivity to amplitude envelope rise time in infancy and vocabulary development at 3 years: A significant relationship.

Here we report, for the first time, a relationship between sensitivity to amplitude envelope rise time in infants and their later vocabulary development. Recent research in auditory neuroscience has revealed that amplitude envelope rise time plays a mechanistic role in speech encoding. Accordingly, individual differences in infant discrimination of amplitude envelope rise times could be expected to relate to individual differences in language acquisition. A group of 50 infants taking part in a longitudinal study contributed rise time discrimination thresholds when aged 7 and 10 months, and their vocabulary development was measured at 3 years. Experimental measures of phonological sensitivity were also administered at 3 years. Linear mixed effect models taking rise time sensitivity as the dependent variable, and controlling for non-verbal IQ, showed significant predictive effects for vocabulary at 3 years, but not for the phonological sensitivity measures. The significant longitudinal relationship between amplitude envelope rise time discrimination and vocabulary development suggests that early rise time discrimination abilities have an impact on speech processing by infants.

Training Children to Perceive Non-native Lexical Tones: Tone Language Background, Bilingualism, and Auditory-Visual Information.

This study investigates the role of language background and bilingual status in the perception of foreign lexical tones. Eight groups of participants, consisting of children of 6 and 8 years from one of four language background (tone or non-tone) × bilingual status (monolingual or bilingual)-Thai monolingual, English monolingual, English-Thai bilingual, and English-Arabic bilingual were trained to perceive the four Mandarin lexical tones. Half the children in each of these eight groups were given auditory-only (AO) training and half auditory-visual (AV) training. In each group Mandarin tone identification was tested before and after (pre- and post-) training with both auditory-only test (ao-test) and auditory-visual test (av test). The effect of training on Mandarin tone identification was minimal for 6-year-olds. On the other hand, 8-year-olds, particularly those with tone language experience showed greater pre- to post-training improvement, and this was best indexed by ao-test trials. Bilingual vs. monolingual background did not facilitate overall improvement due to training, but it did modulate the efficacy of the Training mode: for bilinguals both AO and AV training, and especially AO, resulted in performance gain; but for monolinguals training was most effective with AV stimuli. Again this effect was best indexed by ao-test trials. These results suggest that tone language experience, be it monolingual or bilingual, is a strong predictor of learning unfamiliar tones; that monolinguals learn best from AV training trials and bilinguals from AO training trials; and that there is no metalinguistic advantage due to bilingualism in learning to perceive lexical tones.

Infant-directed speech facilitates seven-month-old infants' cortical tracking of speech.

This study assessed cortical tracking of temporal information in incoming natural speech in seven-month-old infants. Cortical tracking refers to the process by which neural activity follows the dynamic patterns of the speech input. In adults, it has been shown to involve attentional mechanisms and to facilitate effective speech encoding. However, in infants, cortical tracking or its effects on speech processing have not been investigated. This study measured cortical tracking of speech in infants and, given the involvement of attentional mechanisms in this process, cortical tracking of both infant-directed speech (IDS), which is highly attractive to infants, and the less captivating adult-directed speech (ADS), were compared. IDS is the speech register parents use when addressing young infants. In comparison to ADS, it is characterised by several acoustic qualities that capture infants' attention to linguistic input and assist language learning. Seven-month-old infants' cortical responses were recorded via electroencephalography as they listened to IDS or ADS recordings. Results showed stronger low-frequency cortical tracking of the speech envelope in IDS than in ADS. This suggests that IDS has a privileged status in facilitating successful cortical tracking of incoming speech which may, in turn, augment infants' early speech processing and even later language development.